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Abstract 

We investigate the complexity of integration and derivative for multivariate polynomials 
in the standard computation model. The integration is in the unit cube [0, 1]'' for a multivari- 
ate polynomial, which has format f{xi, ■ ■ ■ , Xd) = Pi{xi, • ■ • , Xd)p2{xi, ■ ■ ■ , Xd) ■ ■ -pkixi, ■ ■ ■ , Xd), 
where each Pi{xi, ■ ■ ■ ,Xd) = X/j-i Iji-'^j) with all single variable polynomials qj{xj) of degree 
at most two and constant coefficients. We show that there is no any factor polynomial time 
approximation for the integration J^^ fi^i, ■ ■ ■ , Xd)dxi ■ ■ ■ dx^ unless P = NP. For the com- 
plexity of multivariate derivative, we consider the functions with the format f{x-i_, ■ ■ ■ ,Xd) = 
Pi{xi,- ■ ■ ,Xd)p2{xi,- ■ ■ ,Xd) ■ ■ -pkixi,- ■ ■ ,Xd), where each pi{xi, ■ ■ ■ ,Xd) is of degree at most 2 
and 0, 1 coefficients. We also show that unless P — NP, there is no any factor polynomial time 

approximation to its derivative axi-^'dx'^'^^ origin point (xi, • • • , Xd) = (0, • • • , 0). Our 

#P-hard result for derivative shows that the derivative is not be easier than the integration in 
high dimension. We also give some tractable cases of high dimension integration and derivative. 

1 Introduction 

Integration and derivative are basic operations in the classical mathematics. Integrations with a large 
number of variables have been found applications in many areas such as finance, nuclear physics, and 
quantum system, etc. The complexity for approximating multivariate integration has been studied by 
measuring the number of function evaluations. For example, Sloan and Wozniakowski proved an ex- 
ponential lower bounds 2^ of function evaluations in order to obtain an approximation with error less 
than the integration itself, which has s variables [9]. The integration J^^ f{xi, ■ ■ ■ , Xs)dx-^ ■ ■ ■ dx^ is 
over the cubic [0, 1]'' for some function /(xi, • • • , Xs)- In the quasi-Monte Carlo method for comput- 
ing Jjg j^jd f{x)dx, it is approximated by ^ fi^i)- This approximation has an error 8( '''"'^^ ), 

which grows exponentially on the dimension number d (see e.x., [71 |S] and the reference papers 
there). 

An integration may be computed by the structure of the function without involving function eval- 
uation. For example, /j^ ^2 x^y^dxdy = (/jp ^ x'^dx) ■ (/jq y^dy) = | • -j = j^- The calculation gives 
the exact value of the integration, but there is no evaluation for the function f{x,y) ~ x^y^. Using 
the computational complexity theory, we study the polynomial time approximation limitation for the 
high dimensional integration for some easily defined functions. In this paper, we consider the high 
dimensional integration for multivariate polynomials, which are defined with format f{xi, • • • , Xd) = 
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Pi{xi, - ■ ■ ,Xd)p2{xi, - ■ ■ ,Xd) ■ ■ -Pkixi, - ■ ■ ,Xd), where each pi{xi, ■ ■ ■ , Xd) = J2j=i^ji^j) ^^^^ Poly- 
nomial qj{xj) of constant degree. Its integration can be computed in polynomial space. We show 
how this problem is related to other hard problem in the field of computational complexity theory. 
Therefore, our model for studying the complexity of high dimensional integration is totally different 
from the existing approaches such as [9], and is more general than the old models. We show that 
there is no any factor polynomial time approximation to the integration problem unless P ~ NP. 

A similar hardness of approximation result is also derived for the derivative of the polynomial 
function. The recent development of monomial testing theory [2j [3j [1] can be used to explain 
the hardness for computing the derivative for a ^ polynomial. For the hardness of the ap- 
proximation for multivariate derivative, we consider the functions with the format f{xi, ■ ■ ■ ,Xd) = 
Pi{xi, - ■ ■ ,Xd)p2ixi, - ■ ■ ,Xd) ■ ■ -Pkixi, - ■ ■ ,Xd), where each • • • , a;^) is of degree 2. We also 

show that unless P — NP, there is no any factor polynomial time approximation to its derivative 

^'^ dxi'-'-dxa "^ ^'^^ origin point (xi, • • • , Xd) = (0, • • • , 0). Our results show that the high dimen- 
sion derivative may not be easier than the high dimension integration. Since both integration and 
derivative are widely used, this approach may help understand the complexity of some mathematics 
systems that involve high dimension integration or derivative. 

Partial derivatives were used in developing deterministic algorithms for the polynomial identity 
problem (for example, see [5]), a fundamental problem in the computational complexity theory. 
Our intractability result for the high dimension derivative over multivariate polynomial points out 
a barrier of this approach. 

Second part of this paper about the inapproximability of derivative is an application of our 
recently developed monomial testing theory [2j |3l [1] . It shows that it is #P-hard to compute the 
derivative of a J| ^ polynomial at the origin point. We also give some tractable cases of high 
dimension integration and derivative. 

In section [3l we give an overview about our method for deriving the inapproximation result of 
high dimension integration. The main result of this paper is the inapproximation for high dimension 
integration, and is presented in section |4l In section [5l we present the inapproximation result for 
high order derivative. Some tractable cases of high dimension integration and derivative are shown 
in section ini 



2 Notations 

Let N = {0, 1, 2, • • •} be the set of all natural numbers. Let = {1, 2, ■ • •} be the set of all positive 
natural numbers. 

Assume that function r{n) is from N to N^. For a functor F{.), which converts a multivariate 
polynomial into a real number, an algorithm A{.) gives an r(7i)-factor approximation to F{f) if it 
satisfies the following conditions: if F{f) > 0, then < A{f) < r{n)F{f)\ and if F{f) < 0, then 
r(n)F{f) < A{f) < where n is the number of variables in /. 

Assume that functions r{Ti) and s{n) are from N to N~^. For a functor F{.), an algorithm A{.) 
gives an {r{n), s(n))-factor approximation to F{f) such that if F{f) > 0, then — s{n) < A{f) < 

r{n)F{f) + s{n); and if F{J) < 0, then r{n)F{f) - s{n) < A{f) < ^ + s(n), where Ji is the 
number of variables in /. 

In this paper, we consider two kinds of functors. The first one is the integration in the unit 
cube for a multivariate polynomial: J^^ f{xi, ■ ■ ■ , Xd)dxi ■ ■ ■ dx^- The second is the derivative 

^^'^^}^■■■^xT^ P"^"^* (a^l, ■ • ■ , ^d) = (0, ■ • • , 0). 

For the complexity of multivariate integration, we consider the functions with the format below: 

/(Xi, ■ ■ ■ ,Xd) = Pl{xi,- ■ ■ ,Xd)p2ixi,- ■ ■ ,Xd) ■ ■ -Pkixi, - ■ ■ ,Xd), 

where each Pi{xi, ■ ■ ■ ,Xd) ~ X]j=i Iji^j) with each single variable polynomials qj{xj) of constant 
degree. This kind multivariate polynomial is called 11 S if the degree of each qj {xj ) is at most c. 
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For the complexity of multivariate derivative, we consider the functions with the format below: 

f{xi, ■■■ ,Xd) = Pl{xi, ■■■ , Xd)p2{xi,- • • • • -Pkixi, ■ ■ ■ ,Xd), 

where each Pi{xi, • • • , Xd) is of a constant degree. The polynomial f{xi, • • • , Xd) is called a J| ^ Yik 
polynomial if the degree of each Pi{xi, • • • , Xd) is at most k. 

An algorithm is subexponential time if it runs in 2" * ' time for all inputs of length n. Define 
subE to be the class of languages that have subexponential time algorithms. 

3 Overview of Our Methods 

In this section, we show the brief idea to derive the main result of this paper (Theorem 3]) . 3SAT 
is an NP-complete problem proved by Cook [J. We show that approximating the integration of 
a ^ S2 polynomial is NP-hard by a reduction from 3SAT problem to it. It is still NP-hard to 
decide a conjunctive normal form that each variable appears at most three times with at most one 
negative time. We assume that each variable has its negation appears at most one time (Otherwise, 
we replace it by its negation). 

We show (see Lemma [5] and equations ([55)1 to (|65l) at its proof) that there exist integer coef- 
ficients polynomial functions gi{x) — ax^ + bx"^ + cx + d, g2(x) = ux -\- v, and f{x) = 2x satisfy 
that /g gi{x)dx = 1, /q g2{x)d^ 1, f{x)dx = 1, J„ gi{x)g2{x)d^ 4, gi{x)f{x)dx = 0, 
lo 92{x)f{x)dx = 0, and gi{x)g2{,x)f{x)dx = 0. 

Example 1. Consider the logical formula F = {xi -|-a;2)(a;i +X2)ixi+X2), which has the sum of 
product expansion xiXiXi + X1X1X2 + X1X2X1 + X1X2X2 + X2X1X1 + X2X1X2 + X2X2X1 + X2X2X2- The 
term X1X1X2 can bring a truth assignment xi ~ true and X2 = true to make F true. As each variable 
appears at most 3 times with at most one negative appearance, the first positive Xi is replaced by 
gi{yi), the second positive Xi is replaced by (72(2/1), and the negative Xi is replaced by f{yi)- It is 
converted into the polynomial 

p(yi,2/2) = (giiyi) + gi{y2)){g2{yi) + f{y2)){f{yi) + g2{y2))- 

The polynomial p{yi, 2/2) has the sum of product expansion 

9iiyi)g2{yi)f{yi) + giiyi)g2{yi)g2iy2) + gi{yi)f{y2)f{yi) + gi{yi)f{y2)g2iy2) + 
S'i(y2)g2(yi)/(yi) +5i(y2).g2(yi),92(2/2) + .gi(y2)/(y2)/(yi) + 5l(^/2)/(^/2)52(2/2)• 
Consider the integration J^q 1^2 piyi,y2)dyj^dy.-^. The integration can be distributed into those 
product terms. /^^ ^2 51 (yi)32 (2/1)32(2/2)^^1^^2 is one of them. We have 

/ gi{yi)g2{yi)g2{.y2)dy,dy2 = (/ gi{,yi)g2{.yi)dy,){ 32(^2)^^2) = 4 • i 4. 

J[0,l]2 J[0,1] J[0,1] 

The integrations for other terms are all non-negative integers. Thus, /jq p(2/ii y2)'^j/i'^j/2 a 
positive integer due to the satisfiability of F. 

Example 2. Consider the logical formula G = {xi + X2)xiX2, which has the sum of product 
expansion X1X1X2 + xiX2X2- Neither X1X1X2 nor X1X2X2 can be satisfied. As each variable appears 
at most 3 times with at most one negative appearance, the first positive Xi is replaced by gi{yi), the 
second positive Xi is replaced by 52 (yi), and the negation case Xi is replaced by f{yi)- It is converted 
into the polynomial 9(2/1, y2) = (giiyi) + .9i(y2))./(yi)./(2/2). The polynomial g(yi,2/2) has the sum 
of product expansion gi{yi)f{yi)f{y2)+gi{y2)f{yi)f{y2)- 

Consider the integration /[o^i]2 q{.yi,y2)dy^dy2, which is identical to /[g gi{yi) f {yi) f {y2)dy^dy2 + 

/[0,i]2 5i(y2)/(yi)/(y2)dyirfy2- We have 

/ 9i{yi)f{yi)f{y2)dy,dy2 = (/ gi{yi)f{yi)dy,){ f{y2)dy2) = o-i^o. 

J[0,1]^ "'[0,11 "'[0,1] 
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We also have 



[ 9i{y2)f{yi)f{y2)dy,dy, = ( f f{yi)dy,){ f .9i(y2)/(y2)d,J = 1 • = 0. 

J[0,l]2 "'[0,1] "'[0,1] 

Therefore, Jjp (l{yiTy2)dy^dy^ ~ due to the unsatisfiabihty of G. Therefore, for any factor 

a{n) > 0, a polynomial time factor a(n)-approximation to the integration of a S2 polynomial 
implies a polynomial time decision for the satisfiability of the corresponding boolean formula. 

4 Intractability of High Dimensional Integration 

In this section, we show that the integration in high dimensional cube [0,1]'' does not have any 
factor approximation. We will reduce an existing NP-complete problem to the integration problem. 
Our main technical contribution is in converting a logical formula into a polynomial. We often use 
a basic property of integration, which can be found in some standard text books of calculus (for ex- 
ample [TT])- Assume function /(cci, • • • , = fi{xi^ , • • • , Xi^^ )f2{xj, , • • • , Xj^^ ), where {xi, • • • , Xd} 
is the disjoint union of {xi-^ , Xi^_^ } and {xj-^ , xj^^ }. Then we have 




In order to make the conversion from logical operation to algebraic operation, we represent 
conjunctive normal form with the following format. For example, the formula {xi +X2){xi +X2)(xi + 
X2) is a conjunctive normal form with two boolean variables xi and X2, where + represents the logical 
V, and . represent the logical /\. 

Definition 1 

• A 3SAT instance is a conjunctive form Ci • C2 • • ■ Cm such each Ci is a disjunction of at most 
three literals. 

• 3SAT is the language of those 3SAT instances that have satisfiable assignments. 

• A (3, 3)-SAT instance is an instance G for SSAT such that for each variable x, the total number 
of times of x and x in G is at most 3, and the total number of times ofxinG is at most 1. 

• (3,3)-S'^T is the language of those (3,3)-5'^r instances that have satisfiable assignments. 

For examples, {x\ + 2:2 + a;3)(a;i + X2)ixi + X2) is both 3SAT and (3, 3)-SAT instance, and also 
belongs to both 3SAT and (3,3)-SAT. On the other hand, [xi + X2 + xz){xi +X2)i^i +X2) is not a 
(3, 3)-SAT instance since xi appears twice in the formula. The following lemma is similar to a result 
derived by Tovey [TO] . 

Lemma 1 There is a polynomial time reduction /(.) from SSAT to {?i,Z)-SAT. 

Proof Let F be an instance for 3SAT. Let's focus on one variable Xi that appears m times in F. 
Introduce a series of variables y^^i, • • • , yi^m for Xi. Convert F to F' by changing the j-th occurrence 
of Xi in F to yi_j for j = 1, • • • , m. Define 

Gxi = {Xt -> yi,l) ■ {yt.l -> yi,2){yia ^ yi,^) ■ (2/^,3 yiA) ■ ■ • {yt,m-l 2/i,m) • (2/i,m ^ X.,) 

= {xt + yi,i) ■ iVi^i + yi.2) ■ (1/^,2 + 2/i,3) ■ (yi,3 + yi-i) ■ ■ ■ {Vt^m-i + 2/^,™) • (^i,™ + ^i)- 
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Each logical formula {x — > y) is equivalent to {x + y). If is true, then Xi, y^^i, • • ■ , yi^m are 
equivalent. 

Convert F' into F" such that i^" = F'Gx^ ■ ■ ■ Gx^i where xi, - ■ ■ ,Xk are all variables in F. 

For each variable x in F" with more than one x, create a new variable y^ , replace each positive 
cc of F by y^, and each negative x by y^. Thus, F" becomes F'" . It is easy to see that F G 3SAT 
iff F" is satisfiable iff F'" e(3,3)-SAT. 

4.1 Integration of nSS2 Polynomial 

Lemma [2] is our main technical lemma. It is used to convert a (3,3)-SAT instance into a J^^S2 
polynomial. 

Lemma 2 There exist integers b,c,d,u, and v such that the functions gi (x) — bx^ +cx + d, g2 (x) = 
ux + V, and f{x) — 2x satisfy that 

1. gi{x)dx, Jq g2{x)dx, Jq f{x)dx, and gi{x)g2{x)dx are all positive integers, and 
^- So 9i{x)fix)dx, g2{x)f{x)dx, and gi{x)g2{x)f{x)dx are all equal to 0. 

Proof We give the details how to derive the functions gi{x) and g2{x) to satisfy the conditions of 
the lemma. In order to avoid solving nonlinear equations, we will fix the two variables u and v in 
the early phase of the construction. 




(3) 




(4) 



, hx cx , . 1 

= {— + — + dx)\l 



(5) 



= -(26 + 3c + 6d). 




(6) 



(7) 




(8) 



2 

i— + vx)\l 



(9) 



-{u + 2v). 



(10) 




-{2u + 3v). 



(13) 



(11) 



(12) 



(14) 



(15) 



We let 



u = -6 (16) 
V ^ A. (17) 



Therefore, we have got 

/ 52(a;)da- = 1 (by equatfons © to dTU])), and (18) 

■/[0,1] 

/ g2{x)f{x)d^ = (by equatfons (ini) to (HSI). (19) 

Jlo.i] 



1 ,.1 

2 



gi{x)g2{x)dx — / {hx + cx + d){ux + v)dx (20) 







(6x^ + cx + d)(-6a; + 4)d;j; (21) 







[ {-Qbx^ - Qcx^ - 6fia; + Abx^ + Acx + 4(^)4 
Jo 



(22) 



{{-&b)x^ + (45 - Qc)x'^ + (4c - 6d)2; + 4d)d^ (23) 



,(-66)a;4 {Ah - &c)x^ Uc-M)x^ , , 

(^^^ + ^ — + - — + ^"^"^^'o ^^^^ 

,(-66) (46 -6c) (4c -6d) ^„ 

(^^+ 3 + 3 +4rf) (25) 

^(3 • (-66) + 4 • (46 - 6c) + 6 • (4c - &d) + AM) (26) 

^((-18 + 16)6 + (-24 + 24)c + (48 - 36)d) (27) 

l((-2)6+12d) (28) 

l(-6 + 6d). (29) 



1 .1 

gi{x)f{x)dx = / [bx^ + cx + d)2xdx (30) 

= 2 /" [bx^ + cx^ + dx)dx (31) 
Jo 

„,bx'^ cx^ dx^ .^.^ ,„„, 

- 2(— + — + — )|J (32) 

c d, ,„„, 

- 2(- + - + -) (33) 

= ^(36 + 4c + 6d). (34) 



1 

gi{x)g2{x)f{x)dx (35) 



6 



1 

{bx'^ + cx + d){ux + v)2xdx (36) 



1 

2 



2 / {bx^ + cx + d){-6x + A)xdo, (37) 
Jo 

2 / {-6bx^ - Qcx^ - Mx + Abx'^ + Acx + 4d)2:d:r (38) 

"'0 



2 / ((-66)a;-^ + (46-6c)a;'' + (4c-6d)a; + 4d)a;4 (39) 
Jo 

^,{-Qb)x^ (46-6c)a;4 (4c - 6d)x3 4d.T2 
„,(-66) (45 -6c) (4c -6d) Ad, 

^(12 • (-66) + 15 • (46 - 6c) + 20 • (4c - 6d) + 120d) (42) 
:^((-72 + 60)6 + (-90 + 80)c + (-120 + 120)d) (43) 
i^(-126-10c) (44) 
^(-66 -5c) (45) 



We need to satisfy the following conditions: 



66 + 5c = (46) 

36 + 4c + 6d = (47) 

— 6 + 6(i = 6721 for some positive integer ni (48) 

26 + 3c + 6(i = 6n2 for some positive integer 712 (49) 



Equation (|46)) makes /j^ gi{x)g2{x)f{x)dx = according to equations (|35|) to p5|) . Equation (|47)) 

makes (7i(x)/(a;)(ia; = according to equations (|30 l) to (p4 |) . Equation pS]) makes j^^^ ^^gi[x)g2[x)dx 

be a positive integer according to equations (PU)) to ([25)) . Equation makes Jj^ gi{x)dx be a 
positive integer according to equations to ([7]). 

Let X and k be integer parameters to be fixed later. We have the solutions below: 

6 = 5x•6^ (50) 

c = — — = — 6x-6'^, (bv equation (|46)) ') and (51) 

o 

d = i(-36-4c) = i(-3- (5a; • 6*^) -4(-6a;- 6^=)) (52) 
6 6 

= 9x-6'=-i (by equation dH])). (53) 

We have the equations: 

-6 + 6d = -5x ■ 6*^ + 6 • (9x • e'^-i) = 4a; • 6*= and (54) 

26 + 3c + 6d = 2-(5.T-6'') + 3-(-6x-6'') + 6-(9a;-6'''"i) (55) 

= (10x-18x + 9a;)6'= = a;-6''. (56) 

Let X ~ 1 and k ~ 1. We have 6 ~ 30, c —36, and d = 9. We also have 

- 6 + 6d = 24 (by equation ^) (57) 

26 + 3c + 6d = 6 (bv equation ([5^). (58) 
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Thus, gi{x) ~ bx^ +cx + d ~ 3Qx^ — 36x + 9, g2{x) — —6a; + 4, and f{x) = 2x. We have the following 
equations to satisfy the conditions in the lemma. 



/' 

Jo 



[ f{x)d,. 
Jo 


= 1, 


(by equation (jS]))) 


(59) 


/ gi{x)dj: 
Jo 


= 1, 


(by equations g]) to 0, and ([58|1 


(60) 


Jo 


= 1, 


(by equation (|18p) 


(61) 


/ 9iix)g2{x)d^ 
Jo 


= 4, 


(by equations ^ to ([29]), and ((57))) 


(62) 


/ 9i{x)fix)dx 
Jo 


= 0, 


(by equations ((201) to ((21]), and (gT))) 


(63) 


/ 92{x)f{x)d^ 
Jo 


= 0, 


(by equation (dn])), and 


(64) 


gi{x)g2{x)f{x)dx 


= 0. 


(by equations ((35)) to ((45)). and the solutions for 


h and c)) (65) 



Lemma 3 There is a polynomial time algorithm h such that given a (3, 3)-SAT instance s(xi, • ■ • , x„), 
it produces a ^2 polynomial h{s(xi, • ■ • , Xn)) — p{yi, ■ ■ • , Vn) to satisfy the following two condi- 
tions: 

1. if s{xi, ■ • ■ , Xn) is satisfiable, then Jj^ viuij ' ' ' j yn)dy^ ■ ■ ■ dy^ is a positive integer; and 

2. if s{xi, ■ • ■ , Xn) is not satisfiable, then j^j„ ' ' ' ^ yn)dy^ ■ ■ ■ dy^ is zero. 

Proof We give two examples to show how a logical formula is converted into a multivariate 
polynomial in section(21 Let polynomials 3i(y),52(?/), and f{y) be defined according to those in 
Lemma (2| 

For a (3, 3)-SAT problem s{xi, • ■ • , a;„), let p{yi, • ■ • , yn) be defined a follows. 

• For the first positive literal Xi in s[xi, ■ ■ ■ ,Xn), replace it with gi{yi). 

• For the second positive literal Xi in s[xi, ■ ■ ■ ,Xn), replace it with g2{yi)- 

• For the negative literal Xi in s(xi, • ■ • , x,i), replace it with fijji). 

The formula s{xi, • • • , Xn) has a sum of product form. It is satisfiable if and only if one term does 
not contain a positive and negative literals for the same variable. If a term contains both Xi and 
Xi, the corresponding term in the sum of product for p(.) contains both gjljji) and f{yi) for some 
j G {1, 2}. This makes it zero after integration by Lemma(2| Therefore, s{xi, • • • , x„) is satisfiable if 
and only if Jjp j^j„ p{yi, ■ • • , yn)dy^ ■ • ■ dy^ is not zero. Furthermore, it is satisfiable, the integration is 
a positive integer by Lemma (2] See the two examples in section (3) The computational time of h is 
clearly polynomial since we convert s to h{s) by replacing each literal by a single variable function 
of degree at most 2. 

Theorem 4 Let a{n) be an arbitrary function from N to . Then there is no polynomial time 
a{n)-factor approximation for the integration of a HS^z polynomial p{xi, • ■ • ,Xn) in the region 
[0,1]" unless P = NP. 



Proof Assume that A{.) is a polynomial time a(ri)-faetor approximation for the integration 
/[o,i]" -P(yi7 • ■ • 7 yn)dyi ■■■d-y„ with n S ^2 polynomial • • • , ?/„). For a (3, 3)-SAT instance s{xi,- ■ ■ , x„), 
let p{yi, ■ ■ ■ ,yn) = h{s{xi, ■ ■ ■ ^ Xn)) according to Lemma |3l By Lemma |3l a (3, 3)-SAT instance 
s{xi, ■ ■ ■ , Xn) is satisfiable if and only if the integration J = J^^ j^j„ p{yi, • ■ • , yn)dy-^ ■ ■ ■ dy^^ is not zero. 
Assume that s{xi, ■ ■ ■ ,x„) is not satisfiable, then we have A{J) e [J/a{n), J ■ a{n)] ~ [0,0], which 
implies A{J) = 0. Assume that s{xi, • • • , Xn) is satisfiable, then we have A{J) G [J/a{n), J ■ a{n)] C 
(0, +oo), which implies A{J) > 0. Thus, s{xi, • • • , Xn) is satisfiable if and only if A{J) > 0. 

Therefore, there is a polynomial time algorithm for solving (3, 3)-SAT, which is NP-complete by 
Lemma m So, P = NP. □ 

Theorem 5 Let a{n) be an arbitrary function from N to iV+. Then there is no subexponential time 
a{n)-factor approximation for the integration of a H ^2 polynomial p(xi, ■ ■ ■ ,Xn) in the region 
[0,1]" unless NP C subE. 

Proof Assume that A{.) is a subexponential time a(n)-factor approximation for the integration 
/[o,i]" P(y^' • ■ ■ ' yn)dyi ■■■dy^ with n E S2 polynomial p{yi, • • ■ , y„). 

For a (3, 3)-SAT instance s(xi, • • • , a;„), let • ■ ■ ,yn) = h{s{xi, • • • , a;„)) according to Lemma[3] 
By Lemma [3l a (3,3)-SAT instance s{xi, ■ ■ ■ , Xn) is satisfiable if and only if the integration J = 
/[o i]n P(yi7 ■ ■ ■ 7 yn)dy^ ■ ■ ■ dy^ is not zero. Assume that s{xi, ■ • • , a;„) is not satisfiable, then we have 
A{J) g [J/a(n), J ■ a(n)] = [0, 0], which implies A{J) ~ 0. Assume that s(xi, • • • , x„) is satisfiable, 
then we have A{J) € [J/a{n), J ■ a{n)] C (0, +00), which implies A{J) > 0. Thus, s(xi, ■ • • , a;„) is 
satisfiable if and only if A{J) > 0. 

Therefore, there is a subexponential time algorithm for solving (3, 3)-SAT, which is NP-complete 
by Lemma n Thus, NP C subE. □ 

Lemma 6 Assume that a(l") is a polynomial time computable function from N to iV+ with a(l") > 
for n. There is a polynomial time algorithm such that given a (3, 5)-SAT instance s{xi, • • • , it 
generates a 11 S ^2 polynomial p{yi, • ■ • , y„) such that if s{xi, ■ • • , x„) is satisfiable, then piyi, ■ • ■ , yn)dy 

is a positive integer at least 3a(l")^; and if s{xi, • • • , Xn) is not satisfiable, /j^ ^„ piyi, ■ • ■ , yn)dyj^...y^ 
is zero. 

Proof For a (3,3)-SAT problem s(xi, • • • , let ^(yi, • • • , ?/„) = h{s{xi, • • • , Xn) be constructed 
as Lemma [3l 

Since a(l") is polynomial time computable, let p{yi, • • ■ , y-n) ~ 3a(l")^g(yi, • • ■ , ?/„), which can 
be computed in a polynomial time. □ 

Theorem 7 Let a(l") be a polynomial time computable function from N to . Then there is no 
polynomial time {a{l'^),a{l'^))- approximation for the integration problem f{xi, • • • , xajdx^ • ■ • dx^ 
for a n S ^2 polynomial /(.) unless P = NP. 

Proof Assume that there is a polynomial time (a(l"), a(l"))-approximation App{.) for the inte- 
gration problem /j^ .^j /(a;i, • • • , Xd)da:i ■ ■ ■ d^^ for a J] ^2 polynomial /(.). 

Let s{xi, • • • , Xn) be an arbitrary (3, 3)-SAT instance. Let p{yi, • • • , y„) be the polynomial ac- 
cording to Lemma [6] 

Let J ~ j^j„ • • ■ , ?/„)(ij,j...y^ . If s(2;i, • ■ • , a;„) is not satisfiable, then J = 0. Otherwise, 
J > 3a(I")2. 
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Assume that s{xi, ■ ■ ■ ,Xn) is not satisfiablc. Since App{J) is an (a(l"), a(l"))-approximation, 
we have App{J) < J ■ a(l") + a(l") = a(l") by the definition in section[21 

Assume that s(a:;i, ■ • • , a;„) is satisfiable. Since App{J) is an (a(l"), a(l"))-approximation, we 

have App{J) > - a(l") > - a(l") = 2a(l") by the definition in section H 

Therefore, s(xi, • • • ,Xn) is satisfiable if and only if App{J) > 2a(l"). Thus, if there is a poly- 
nomial time (a(l"), a(l"))-approximation, then there is a polynomial time algorithm for solving 
(3, 3)-SAT. By Lemma [H P = NP. 

The well known exponential time hypothesis says NP 2 subE [5]. Basing on such a hypothesis, 
we have the following stronger result about the intractability of high dimension integration. 

Theorem 8 Let a(l") be a polynomial time computable function from N to . Ttien there is no 
subexponential time (a(l"), a{V^))- approximation for ttie integration problem J^^ f{xi, ■ ■ • , Xd)dx^ ■ ■ ■ d 
with a n S ^2 polynomial /(.) unless NP C subE. 

Proof Assume that there is a subexponential time (a(l"), a(l"))-approximation App{.) for the 
integration problem /j^ -^j f{xi,- ■ ■ , Xd)dxi ■ ■ ■ dx^ with a S ^2 polynomial /(.). 

Let s(a;i, • • ■ , Xn) be an arbitrary (3, 3)-SAT instance. Let p{yi, ■ • ■ , yn) be the polynomial ac- 
cording to Lemmaini Let J = Jj^ j^j„ p{yi, • • • , yn)dy^...y^. By LemmalHl we have J > 0. 

If s{xi, • • • , Xn) is not satisfiable, then J = 0. Otherwise, J > 3a(l")^. 

Assume that s(a;i, • • • , .t„) is not satisfiable. Since App(J) is an (a(l"), a(l"))-approximation, 
we have App{J) < J ■ a(l") -I- a(l") = a(l") by the definition in section [2] 

Assume that s{xi, ■ ■ ■ ,Xn) is satisfiable. Since App{J) is an (a(l"), a(l"))-approximation, we 
have App{J) > - a(l") > - a(l") = 2a(l") by the definition in section [H 

Therefore, s(xi, • • • , a;„) is satisfiable if and only if App{J) > 2a(l"). Thus, if there is a subexpo- 
nential time (a(l"), a(l"))-approximation, then there is a subexponential time algorithm for solving 
(3,3)-SAT. By LcmmalU NP C subE. 



5 Inapproximation of Derivative 

In this section, we study the hardness of high dimensional derivative. We derive the inapproximation 
results under both NP ^ P and NP ^ subE assumptions. 

Definition 2 A monomial is an expression x^^ ■ ■ ■ x"^"^ and its degree is ai + ■ ■ ■ + a^- A monomial 
Xi^ ■ ■ ■ x'^'^ , in which xi, ■ ■ ■ ,Xd are different variables, is a multilinear if ai ~ 02 ^ ■ ■ ■ = = 1- 

For example, {xix^ + x'^){x2Xi + a;|) is a JlX]n2 polynomial. It has a multilinear monomial 
xiX2X'iX4^ in its sum of products expansion. 

We give Lemma [5] to convert an instance / for (3, 3)-SAT into a J| ^ polynomial. The 
technology developed in [51 [T] will be applied in the construction. 

Lemma 9 Let a(l") be a polynomial time computable function from N to . Then there is 
a polynomial time algorithm A such that given a (3,3)-5'^T' instance F(jji, - ■ ■ ^y^), the algorithm 
returns a H S 112 polynomial G{xi, • • • , Xn) such that 

L If F is not satisfiable, then G does not have a multiliear monomial with an nonzero coefficient in 
its sum of product expansion. 

2. If F is satisfiable, then G has the multiliear monomial xi ■ ■ ■ Xn with a positive integer coefficient 
at least 3a(l")^ in its sum of product expansion. 
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Proof Let (3, 3)-SAT instance F be C1C2 ■ ■ ■ Ck- Each clause Ci has format y*_^ + y*^ + y* , where 
hteral y* is either yj or its negation yj. Since _F is a (3, 3)-SAT instance, for each variable j/i in F, 
yi and totally appear at most three times in F, and appears at most once in F. 

For each variable yi in F, create four new variables z^^i, Zi^2, Ui,i and Ui,2- Convert formula F 
into polynomial Gi such that for each yi in F, the first positive occurrence yi is changed into 2:^.11x^^1, 
the second positive occurrence yi is changed into 2:^.21x^.2, and the negative occurrence is changed 
to Zi^iZi^2- After the conversion for all the variables, formula F is transformed into a polynomial Gi. 
We have that F is satisfiable if and only if Gi has a multilinear monomial with positive coefficient 
in its sum of products expansion. This is because a multiliear monomial in the sum of product 
expansion of Gi corresponds a consistent conjunctive term, which does not contain both yi and its 
negation y.^ for some variable yi, in the sum of product expansion of F. 

Let Hi be the set of all variables in Gi . Assume that c?i is the degree of Gi (it is easy to see that 
all monomials in the sum-product expansion of Gi have the same degree di). Let m be the number 
of variables in Hi. Let d be the number of boolean variables in F. Assume that no clause Ci in F 
contains a single literal (otherwise, we can force the literal to be true to simplify F). The number of 
clauses in F is at most ^ since each variable appears in F at most three times and each clause Ci 
of F contains at least two literals. The degree Gi is at most 3d since each literal of F is replaced by 
a product of two variables. The number of variables in Gi is m = Ad (we create four new variables 
for each variable in F), which is larger than the degree of Gi. 

Create new variables wi, • • • ,Vm-di- For = 1, • • • , to — di, let = J2x£Hi ^'"j- Finally, we get 
the polynomial G — 3a(l")^ ■ Gi ■ qi- ■ -qm-di, where n = m + {m — di). Note that 3a(l")^ in the 
polynomial G is considered an integer constant which does not contain any variable. The degree of 
G is n = di + 2(to — di) = m + {m — di) . Thus, the degree of G is the same as the total number 
of variables in g. We can show that / is satisfiable if and only if there is a multilinear monomial, 
which is the product of all variables in G, with positive coefficient of size at least 3a(l")^. 



Theorem 10 Assume that r{n) is a function from N to . If there is a polynomial time algorithm 
A such that given a Jl 112 polynomial g{xi, - ■ ■ ,x„), it gives an r{n)-factor approximation to 

a ^^.'^fl '^"^ '^^ origin point (xi, • ■ • , x„) = (0, • • • , 0), then P ~ NP. 



Proof Assume that A{.) is a polynomial time r(n)-approximation for computing ^ dxi--'dx''^" 
the origin point {xi, ■ • • , a;„) = (0, • • ■ , 0). 

Assume that / is an arbitrary formula in a (3, 3)-SAT problem. By Lemma ^ we can get a 

polynomial g{xi, ■ ■ ■ ,a;„). The derivative ^^^^ ^^g'^''^'' is equal to the coefficient of xi • • ■ Xn in the 
sum of product expansion of g. 

If / is satisfiable, we have A{g) > 0, and if / is not satisfiable, we have A{g) ~ since A{.) is a 
r(n)-approximation and r{n) > 1. We can know if the coefficient of xi ■ ■ ■ x„ in the sum of product 
expansion of g is positive in polynomial time. Thus, (3, 3)-SAT is solvable in polynomial time. Since 
(3, 3)-SAT is NP-complete, we have P = NP. 

Basing on exponential time hypothesis NP ^ subE [5], we have the following stronger result 
about the intractability of high dimension derivative. 

Theorem 11 Assume that r{n) is a function from N to . If there is a suhexponential time algo- 
rithm A such that given aWY^ polynomial g{xi, • • • , Xn), it gives an r{n)-factor approximation 

dxi—dx'^'^^ '^^ on^rm point (xi, • • • , a;„) = (0, • • • , 0), then NP C subE. 



Proof Assume that A{.) is a suhexponential time r(n)-approximation for computing 
at the origin point (xi, • • ■ , x„) = (0, ■ • • , 0). 
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Assume that / is an arbitrary formula in a (3, 3)-SAT problem. By Lemma El we can get a 

polynomial g{xi, ■ ■ ■ ,a;„). The derivative ^^g^i^^x '^^ equal to the coefficient of Xi ■ ■ ■ Xn in the 
sum of product expansion of g. 

If / is satisfiable, we have A{g) > 0, and if / is not satisfiable, we have A{g) = since A{.) is a 
r(n)-approximation and r{n) > 1. We can know if the coefficient of xi ■ ■ ■ Xn in the sum of product 
expansion of g is positive in subexponential time. Thus, (3, 3)-SAT is solvable in subexponential 
time. Since (3, 3)-SAT is NP-complete, we have NP C subE. 

Theorem 12 Let a(l") be a polynomial time computable function from N to . Then there is 

no polynomial time {a{V^),a{l"))-approximation for a^i— aic'^"'* ^'^'^ ^(^^ij ' ' ' y^n) as a OS 112 
polynomial at the origin point {xi, ■ ■ ■ , Xn) = (0, ■ • • , 0), unless P = NP. 

ft f 

Proof Assume that App{.) is a polynomial time (a(l"), a(l"))-approximation for computing ^ dxi--c 
at the origin point • • ■ , Xn) = (0, ■ • • , 0). 

Given an arbitrary (3,3)-SAT instance F, let the H S 112 polynomial G(a;i, • ■ • , a;„) be con- 
structed according to Lemma [9l 

If F is not satisfiable, then we have gJf.^.Q^ '^"^^ is zero at the origin point (xi,---,a:„) = 
(0, • • • ,0). Otherwise, it is at least 30(1")^. 

Assume that F is not satisfiable. Since App{J) is an (a(l"), a(l"))-approximation, we have 
App{J) < J ■ a(l") + a(l") = a(l") by the definition in section[3 

Assume that F is satisfiable. Since App(J) is an (a(l"), a(l"))-approximation, we have App{J) > 
■^jj^ - a(l") > - a(l") = 2a(l") by the definition in section^ 

Therefore, F is satisfiable if and only if App{J) > 2a(l"). Thus, if there is a polynomial time 
(a(l"), a(l"))-approximation, then there is a polynomial time algorithm for solving (3,3)-SAT. By 
Lemma [11 P = NP. 

Theorem 13 Let a(l") be a polynomial time computable function from N to . Then there is no 

subexponential time (a(l"), a{\'^))- approximation for '^^ Oo;^ — Ox'^"^ origin point (xi, • • • , a;„) = 

(0, • • ■ , 0) , unless NP C subE. 

Proof The proof is similar to that of Theorem [T2l 



6 Some Tractable Integrations and Derivatives 

In this section, we present some polynomial time algorithms for integration with some restrictions. 
We also show a case that the derivative can fully polynomial time approximation scheme. 

6.1 Bounded Width Product 

Definition 3 A formula /i • /2 • • • fm is c-wide if for each variables Xi, there is an index j such that 
Xi only appears in fj, fj+i, ■ ■ ■ fj+c-i, where each fi is a sum of monomials. 

Theorem 14 There is an 0(mn^'^) time algorithm to compute the integration ^-^^ F{xi, ■ ■ ■ ^xj) 
for a c-wide formula F{xi, • • • , Xd) = fi ■ ■ • fm, where n is the total length of F. 
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Proof Apply the divide and conquer method. Convert F into F1GF2 such that G is a product of 
at most c sub- formulas /i • ■ • fj with j — i = c in the middle region of F (we can let i = [-^^x^] + 1, 
andj = [2^] +c). 

Let 5*1 be the set of variables that are only in Fi , S2 be the set of variables that are only in F2 , 
and S be the set of variables that appear in G. The set of variables in F is partitioned into S'l, S, 
and 82- 

As Fi = we convert Fi into F^ ~ /I'-'/j-c/i, where /* is the product of the 

last c sub- formulas: fi = fi-c ■ ■ ■ fi-i- Similarly, as F2 ~ fj+i ■ ■ ■ fm, we convert F2 into F2 = 
f2 fj+c ■ ■ • fmi where /| is the product of the first c sub-formulas: /2 = fj+i ■ ■ ■ fj+c- Convert G 
into the sum of products. 

We have 

/ Fixi,---,xd)d,,---d,, - / G-i[ Fids,)-i[ F2ds,)ds 

= / G-{[ F*ds,)-{f F*ds,)ds. 

J[0,1]I^I J[04]l''il J[0,1]IS2 

The integration Jjp j^jis^i Fids^ can be expressed as a polynomial of variables in 5*. The integration 
/[o i]i-s2i F2ds2 can be expressed as a polynomial of variables in S. 

We have the recursive equation for the computational time T{m) = 2T(m/2) -I- 0{n?'^). This 
gives T(m) = Oijnn^^). 

6.2 Tractable Derivative 

In this section, we show that computing the derivative of a class of ^ polynomial is T^P-hard, 
and also give a polynomial time randomized approximation scheme by using the theory of testing 
monomials developed by Chen and Fu [21 [1] . 

Definition 4 Let f{xi, ■ ■ ■ , Xd) = Pi{xi, • • • , Xd) ■ • •Pfe(xi, ■ • • , Xd) he aY\^ polynomial. If for each 
Pi{xi, • • ■ , Xd), each variable's coefficient is either or 1, then f is called a Y[ X)* polynomial. 

We show that the derivative for a X* polynomial has a polynomial time approximation scheme. 
Chen and Fu derived the following theorem by a reduction from the number of perfect matchings in 
a bipartite. 

Theorem 15 (Chen and Fu [l]) 

1. There is a polynomial time randomized algorithm to approximate the coefficient of a Y[^* Poly- 
nomial. 

2. It is ffP-hard to compute the coefficient of the multilinear xi ■ ■ ■ Xd in a Y[ X^* polynomial 

/(Xl, ■ • ■ ,Xd). 

Theorem (TS] implies Theorem \W[ 
Theorem 16 

1. Let e he an arbitrary constant in (0,1). Then there is a polynomial time randomized algorithm 
that given a HX* polynomial f , it returns a (1 + e)- approximation for ^^^q^' ..'gf' — o,t the point 
(0,---,0). 

2. It is ffP-hard to compute — o.t the point (0, ■ • • , 0) for a Y\ X* polynomial f . 

Proof For a Ff Y]* polynomial fixi, • • • , Xd), its '^^^^f '"'^^^'■f — at the point (0, • ■ • , 0) is identical to 
the coefficient of the monomial xi ■ ■ ■ Xd in the sum of products in the expansion of f{xi, • • ■ , Xd). 
The theorem follows from Theorem [T51 
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7 Conclusions 



Using the theory of NP-hardness, we characterize the intractabihty of approximation for two fun- 
damental mathematical operations: Integration and derivative in high dimensional space. We may 
see that this approach will be applied to determining the computational complexity of more math- 
ematics systems that involve integration and derivative. We show that derivative for Y[ J2 ¥[2 
#P-hard. Both integration and derivative for H 11 polynomials are in the class This shows 
that derivative is not easier than integration in the high dimension. 

References 

[1] Z. Chen and B. Fu. Approximating multilinear monomial coefficients and maximum multilinear 
monomials in multivariate polynomials. Electronic Colloquium on Computational Complexit, 
ECCC-TRlO-124, 2010. 

[2] Z. Chen and B. Fu. The complexity of testing monomials in multivariate polynomials. Electronic 
Colloquium on Computational Complexit, ECCC-TRlO-114, 2010. 

[3] Z. Chen, B. Fu, Y. Liu, and R. Schwcller. Algorithms for testing monomials in multivariate 
polynomials. Electronic Colloquium on Computational Complexity, ECCC-TRlO-114, 2010. 

[4] S. A. Cook. The complexity of theorem-proving procedures. In STOC, pages 151-158, 1971. 

[5] R. Impagliazzo and R. Paturi. The complexity of k-sat. In Proceedings of the 14-th IEEE 
Conference on Computational Complexity, page 237 240, 1999. 

[6] H. Niederreiter. Quasi-monte carlo methods and pseudo-random numbers. Bulletin of the 
American Mathematical Society, 84(6):957-1041, 1978. 

[7] H. Niederreiter. Random Number Generation and quasi-Monte Carlo Methods, volume 63. 
SIAM, Philadelphia, 1992. 

[8] A. Shpilka and I. Volkovich. Read-once polynomial identity testing. In Proceedings of the 40th 
Annual ACM Symposium on Theory of Computing, pages 507-516, 2008. 

[9] I. H. Sloan and H. Wozniakowski. An intractability result for multiple integration. Math. 
Comput., 66(219):1119-1124, 1997. 

[10] C. A. Tovey. A simplified satisfiability problem. Discrete Applied Mathematics, 8:85 89, 1984. 

[11] W. F. Trench. Advanced Calculus. Harper & Row, New York, 1978. 



14 



